Entropy production and Pesin-like identity at the onset of chaos 
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Asymptotically entropy of chaotic systems increases linearly and the sensitivity to initial condi- 
tions is exponential with time: these two behaviors are related. Such relationship is the analogous 
of and under specific conditions has been shown to coincide with the Pesin identity. Numerical evi- 
dences support the proposal that the statistical formalism can be extended to the edge of chaos by 
using a specific generalization of the exponential and of the Boltzmann-Gibbs entropy. We extend 
this picture and a Pesin-like identity to a wide class of deformed entropies and exponentials using 
the logistic map as a test case. The physical criterion of finite-entropy growth strongly restricts the 
suitable entropies. The nature and characteristics of this generalization are clarified. 
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It has been suggested that exponential and power-law 
sensitivity to initial conditions of chaotic systems could 
be unified through the concept of generalized exponential 
leading to the definition of generalized Lyapunov expo- 
nents l]: the sensitivity ^ = limA2:(o)^o ^2^(i)/^a;(0) 
grows asymptotically as a generalized exponential 
exp(At), where exp(a;) — expq(a;) = [1 -I- (1 — g)a;]^/^-^^'^; 
the exponential behavior for the chaotic regime is recov- 
ered for q ^ 1: limq^i exp^(Agt) = exp(At). 

The Kolmogorov-Sinai (K-S) entropy is defined as the 
time-averaged production rate of Shannon entropy over 
the joint probability for the trajectory to pass through 
a given sequence of steps in phase space with appropri- 
ate coding of the sequence and limit of the volume that 
characterize the steps. The K-S definition for most sys- 
tems is not easily amenable to numerical evaluation and 
not directly equivalent to the usual thermal or statistical 
entropy. The connection between the K-S entropy pro- 
duction rate and the statistical entropy of fully chaotic 
systems and, in particular, of the three successive stages 
in the entropy time evolution is discussed in Ref . . Af- 
ter a first initial-condition-dependent stage, the entropy 
grows linearly in the limit of infinitely fine coarse grain- 
ing: this is the characteristic asymptotic regime. The last 
stage depends on the practical limitation of the coarse 
graining. 

Since this statistical definition of entropy production 
rate, where an ensemble of initial conditions confined to 
a small region is let evolve, appears to be relevant to 
thermal processes and practically coincides with the K-S 
entropy in chaotic regimes , we use it and call from now 
one K-S entropy K, even if it is in principle different. 

The rate of loss of information relevant for the above- 
mentioned systems, which include both full-chaotic and 
edge-of-chaos cases, should be suitably generahzed. In 
fact at the edge of chaos this picture appears to be re- 
covered with the generalized entropic form proposed by 
Tsallis •S'g = (1— X^i^li Pi which grows linearly 

for a specific value of the entropic parameter q = ^sons = 
0.2445 for the logistic map: limt^oo hm^^o = 



Kq, where Sq 



reduces to — l^gpi in the limit 

q ^ 1 Pi being the fraction of the ensemble found in the 
i-th cell of linear size L. The same exponent describes 
the asymptotic power-law sensitivity to initial conditions 
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Finally, it has been also conjectured that the relation- 
ship between the asymptotic entropy-production rate K 
and the Lyapunov exponent A for chaotic systems (Pesin- 
like identity) can be extended to Kq ~ Xq 

Numerical evidences supporting this framework with 
the entropic form Sq have been found for the logistic 
and generalized logistic- like maps . Ref. gives scal- 
ing arguments that relate the asymptotic power-law be- 
havior of the sensitivity to the fractal scaling properties 
of the attractor. Finite-size scaling relates numerically 
the entropic parameter q to the power-law convergence 
to the box measure of the attractor from initial conditions 
uniformly spread over phase space 0, 1^1 ■ The linear be- 
havior of the generalized entropy for specific choices of 
q has been observed for two families of one-dimensional 
dissipative maps fl. 

Renormalization-group methods have been recently 
used 0, 01 to demonstrate that the asymptotic (large 
t) behavior of the sensitivity to initial conditions in the 
logistic and generalized logistic maps is bounded by a 
specific power-law whose exponent could be determined 
analytically for initial conditions on the attractor. Again 
for evolution on the attractor the connection between en- 
tropy and sensitivity has been studied analytically and 
numerically, validating a Pesin-like identity for Tsallis' 
entropic form [l^ . 

Sensitivity and entropy production have been stud- 
ied in one-dimensional dissipative maps using ensemble- 
averaged initial conditions chosen uniformly over the in- 
terval embedding the attractor the statistical pic- 
ture, i.e., the relation between sensitivity and entropy ex- 
ponents and the Pesin-like identity, has been confirmed 
even if with a different q — q^^°g = 0.35 0. Indeed the 
ensemble-averaged initial conditions appear more rele- 
vant for the connection between ergodicity and chaos and 
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for practical experimental settings. The same analysis 
has been repeated for two symplectic standard maps '14'|. 

The main objective of the present work is to demon- 
strate the more general validity of the above-described 
picture and, specifically, of the extended Pesin-like iden- 
tity and of the physical criterion of finite-entropy pro- 
duction per unit time (linear growth), which strongly 
selects appropriate entropies and fixes their parame- 
ters. For this purpose we use the coherent statistical 
framework ari sing from the following two-parameter fam- 
ily El III IH III III 113 of logarithms 



log(0 



(1) 



where a (/3) characterizes the large (small) argu- 
ment asymptotic behavior; in particular, exp(Ai) = 

log (At) {Xty/°' for large t. The requirements that 
the logarithm be an increasing function, therefore invert- 
ible, with negative concavity (the related entropy is sta- 
ble), and that the exponential be normalizable for nega- 
tive arguments (see Ref. for a discussion of the cri- 
teria) select < q; < 1 and < /3 < 1 |23|; solutions 
with negative a and /3 are duplicate, since the family 
possesses the symmetry a <-> — /3. We have studied the 
entire class of logarithms and exponentials and will show 
results for the following four interesting one-parameter 
cases: 

(1) the original Tsallis proposal 3]: a — 1 ~ q and 

/3 = 0; 

(2) the Abe logarithm: qa — 1/(1 -fa) and /? = a/(l + 
a), named after the entropy introduced by Abe |22l| . 
which possesses the symmetry qa ^ ^/qa] 

(3) the Kaniadakis logarithm: a = P — k, which shares 
the same symmetry group of the relativistic momentum 
transformation and ha s ap plications in cosmic-ray and 
plasma physics IH 0, l25l| : 

(4) in addition we have considered a sample spanning 
the entire class (values of /?): in this letter we show re- 
sults for the choice a — 2(3 — 27, which we label 7 loga- 
rithm 29]. 

We study the sensitivity to initial conditions and the 
entropy production in the logistic map x^+i — \ — fjLxf, at 
the infinite bifurcation point /ioo = 1.401155189. If the 
sensitivity follows a deformed exponential ^(t) — exp(At), 
analogously to the chaotic regime when ^{t) ~ exp(At), 
the corresponding deformed logarithm of ^ should yield 
a straight hue log(^(t)) = log(ex]5(Af)) = \t. 

The sensitivity has been calculated using the exact 
formula for the logistic map ^(t) = (2/i)* Hi^o l^^d fo^' 
1 < t < 80, and the generalized logarithm log(^) has been 
uniformly averaged over the entire interval — 1 < xo < 1 
by randomly choosing 4 x 10^ initial conditions. The 
averaging over initial conditions, indicated by (•••), is 
appropriate for a comparison with the entropy produc- 
tion. 



Guided by Ref. [I3 , for each of several generalized log- 
arithms, (log(^(t))) has been fitted to a quadratic func- 
tion for 1 < i < 80 and a has been chosen such th;jt^the 
coefficient of the quadratic term be zero; in fact log(^) 
linear in t means that the sensitivity ^ behaves as exp(At): 
we label this value agens- 

In fact, the exponent obtained with this procedure has 
been denoted g^p^g in the case of Tsallis' entropy E3 to 
mark the difference with the exponent Qsons obtained by 
choosing an initial condition at the fixed point of the map 

xo = lii. 

Table reports the values of afj^g corresponding to 
four different choices of the logarithm with the shown 
statistical errors calculated by repeating the fitting pro- 
cedure for sub-samples of the 4 x 10^ initial conditions; 
in addition we estimate a systematic error of about 0.004 
by fitting over different ranges of t. The exponent we find 
using Tsallis' formulation a^^^ = 0.644 ±0.002 is consis- 
tent within the errors with the value quoted in Ref. 01 
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0.36. 



The values of a^J^j, 



are within 



±1%: taking into account the systematic error arising 
from the inclusion in the global fitting of small values 
of ^, for which the different formulations have not yet 
reached their common asymptotic behavior (at least at 
the level of 1%), it can be estimated a^^„, = 0.650±0.005. 

Figure n shows the straight-line behavior of log(^) for 
all four formulations when a — a^^^^g: the corresponding 
slopes A (generalized Lyapunov exponents) are reported 
in Tabled with their statistical errors; a systematic error 
of about 0.003 has been estimated by different choices 
of the range of t. While the values of a are consistent 
with a universal exponent independent of the particular 
deformation, the slope A strongly depends on the choice 
of the logarithm. 

The entropy has been calculated by dividing the in- 
terval (—1, 1) in = 10^ equal-size boxes, putting at 
the initial time N — 10^ copies of the system with an 
uniform random distribution within one box, and then 
letting the systems evolve according to the map. At each 
time Pi{t) = ni{t)/N, where ni{t) is the number of sys- 
tems found in the i-th box at time t, the entropy of the 
ensemble is 




S{t) 



where (• ■ •) is an average over 2 x 



one starting from one box randomly chosen among the W 
boxes. The choice of the entropic form ^ is fundamental 
for a coherent statistical picture: the usual constrained 
variation of the entropy in Eq. (0) respect to pi yields 
as distribution the deformed exponential exp(x) whose 
inverse is indeed the logarithm appearing in Eq. . 

Analogously to the strong chaotic case, where an ex- 
ponential sensitivity (a = /3 = 0) is associated to a lin- 
ear rising Shannon entropy, which is defined in terms of 
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TABLE I: For each of the generahzed logarithms hsted in the first row the following quantities are given: the exponents of the 
leading-power behavior for large- (a) and small- arguments according to Eq. the experimental generalized Lyapunov 
exponents A (see Fig. and the experimental rates of entropy growth K (see Fig. |5J , which verify the generalized Pesin-like 
identity K — X; the asymptotic {vcS = oo) and corrected {veB = 20) theoretical predictions for K/^ relative to Kq (/3 = or 
Tsallis' case) from Eq. (O, and the corresponding experimental values. Statistical errors are shown. 





Tsallis 


7 


Abe 


Kaniadakis 


a 


0.644 ± 0.002 


0.656 ± 0.002 


0.657 ± 0.002 


0.653 ± 0.002 


P 





0.328 


0.396 


0.653 


A 


0.271 ±0.003 


0.198 ±0.002 


0.185 ± 0.002 


0.148 ± 0.001 


K 


0.267 ±0.003 


0.197 ± 0.002 


0.186 ± 0.002 


0.152 ± 0.002 


(^/^0)Aev..p 


1 


0.667 


0.623 


0.500 


(^/^0)Theo.. 


1 


0.736 


0.695 


0.571 




1 


n ^QQ -1- n rjQ^ 


0.697 ± 0.004 


0.569 ± 0.004 



24 



20 



16 
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FIG. 1: Generalized logarithms log(^), see Eq. of the 
sensitivity to initial conditions averaged over 4 x 10^ uniformly 
distributed initial conditions as function of time. From top to 
bottom: Tsallis', 7, Abe's, and Kaniadakis' logarithms. The 
linear rising behavior has been obtained with the asymptotic 
powers a shown in Table |I] the corresponding generalized 
Lyapunov exponents A can also be read in Table d 



the usual logarithm {a — P — 0), and consistently with 
the conjecture in Ref. l], the same values a and /3 of 
the sensitivity are used in Eq. Fig. |21 shows that 

this choice leads to entropies that grow also linearly. We 
have also verified that this linear behavior is lost for val- 
ues of the exponent a different from a^^^^^, confirming 
for the whole class (0 what was already known for the 
g-logarithm [1E3- 

In Table 01 we report the rate of growth of several en- 
tropies Kjs = Sp{t)/t] the statistical errors have been 
again estimated by sub-sampling the experiments. While 
this rate K depends on the choice of the entropy, the 
Pesin-like identity holds for each given deformation: 
Kp = A^. 

There exists an intuitive explanation of the dependence 
of the value of K on /3, i.e., on the choice of the deforma- 




FIG. 2: Entropy as function of time, averaged over 2 x 10 
experiments, each one with an ensemble of 10^ points over a 
grid of 10^ boxes. The entropies belong to the class of Eq. Q 
and are defined with exactly the same exponents a and P 
used for the sensitivities; as in Fig. the curves show Tsal- 
lis', 7, Abe's, and Kaniadakis' entropies from top to bottom. 
Straight lines are guides to the eyes. The resulting rates of 
growth of entropy K can be read in Table |T| 



tion. If the ensemble at time t is spread approximately 
uniformly over v boxes, while the other iW — v) boxes 
arc practically empty the entropy is S{t) « \og{v{t)) ~ 



{t)]/{a + j3), being v an effective average 



number of occupied boxes. Since the exponent a is a 
property of the map, and practically independent of the 
entropic form, and choosing the rate of growth of Tsallis' 
entropy Kq, which corresponds to /3 = 0, as reference, 
the dependence of Kfj on the choice of (3 results: 



Kq \ a 



1 - j/-"-'^ 



(3) 



1 - J/-" 

The first factor is the asymptotic (i^ 1) ratio that de- 
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pends only on a and /3, while the second factor gives 
the leading finite size correction. The last three lines of 
Table ^ compare the asymptotic and corrected theoreti- 
cal predictions of Eq. ^ with the numerical experiment: 
this intuitive picture appears to hold with a 10% discrep- 
ancy between the asymptotic value and the corrected one 
which in turns reproduces accurately the experimental re- 
sults with an effective number of occupied boxes v 
This result is clearly not restricted to the four represen- 
tative cases explicitly shown. 

In summary, numerical evidence corroborates and ex- 
tends Tsallis' conjecture that, analogously to strongly 
chaotic systems, also weak chaotic systems can be de- 
scribed by an appropriate statistical formalism. Such 
extended formalisms should verify precise requirements 
(concavity, Lesche stability |2^, and finite-entropy pro- 
duction per unit time) to both correctly describe chaotic 
systems and provide a coherent statistical framework: es- 
pecially the last criterion restricts the entropic forms to 
the ones with the correct asymptotic behavior. These 
results have been exemplified in a specific two-parameter 
class that meets all these requirements: it is the simplest 
power-law form describing small and large probability 
behavior and includes Tsallis's seminal proposal. More 
specifically, the logistic map shows 

(i) a power-low sensitivity to initial condition with a 
specific exponent ^ ^ t^/°', where a = 0.650 ± 0.005; 
this sensitivity can be described by deformed exponen- 
tials with the same asymptotic behavior ^{t) — exp(At) 
(see Fig. ^ for examples) ; 

(ii) a constant asymptotic entropy production rate (see 
Fig. 12) for trace-form entropies with a specific power- 
behavior p^^" in the limit of small probabilities only 
when the exponent a is the same appearing in the sensi- 
tivity; 

(iii) the asymptotic exponent a is related to parame- 
ters of known entropies: for instance a ~ 1 — q, where 
q is the entropic index of Tsallis' thermodynamics 

a — 1/qA — 1, where qA appears in a generalization of 
Abe's entropy j22| : a = k, where k is the parameter in 
Kaniadakis' statistics p[l2ll25j |: 

(iv) a generalized Pesin-like identity holds S/^/t 
Kjs = XjS for each choice of entropy and corresponding 
exponential in the class, even if the value of K/^ = 
depends on the specific entropy (or choice of (3) and it is 
not characteristic of the map as it is a (see Table 13 for 
examples) ; 

(v) the ratios between the entropy production rates Kf^ 
(analogous of the K-S entropy) from different members 
of the class of entropies in Eq. (0) can be theoretically 
understood from the knowledge of the power behavior of 
the deformed logarithm for large and small values of the 
argument, Eq. 0, and the predictions are confirmed by 
numerical experiments (see Table IJ). 

Weakly chaotic systems can be characterized by defor- 
mations of statistical mechanics that yield entropic forms 



with the appropriate power-law asymptotic [pi — !■ 0) be- 
havior and a consequent asymptotic power-law behavior 
of the corresponding exponential. 

We remark that the physical criterion of requiring that 
the entropy production rate reaches a finite and non-zero 
asymptotic value has two consequences: (a) it selects a 
specific value of the parameter a {a is characteristic of 
the system) ; (b) strongly restricts the kind of acceptable 
entropies to the ones that have asymptotic power-law be- 
havior (for instance it excludes Renyi entropy 
The reason we ask for a finite non-zero slope is that oth- 
erwise we would miss an important characteristic of the 
system: its asymptotic exponent. 

The proper generalization of the Pesin-like identity in- 
volves two distinct points: (1) the correspondence be- 
tween the power-law behavior of the sensitivity for large 
times and of the proper entropy for small occupation 
probability (this power-law is independent of the gener- 
alization chosen); and (2) the equality of the generalized 
Lyapunov exponent and the entropy production rate: the 
numerical value is in this case dependent on the choice 
of the entropy. 
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